Discrete-time Markov control processes with recursive discount rates
نویسندگان
چکیده
منابع مشابه
Discrete Time Markov Processes
What follows is a quick survey of the main ingredients in the theory of discrete-time Markov processes. It is a birds' view, rather than the deenitive \state of the art." To maximize accessibility, the nomenclature of mathematical probability is avoided, although rigor is not sacriiced. To compensate, examples (and counterexamples) abound and the bibliography is annotated. Relevance to control ...
متن کاملMarkov Decision Processes with General Discount Functions
In Markov Decision Processes, the discount function determines how much the reward for each point in time adds to the value of the process, and thus deeply a ects the optimal policy. Two cases of discount functions are well known and analyzed. The rst is no discounting at all, which correspond to the totaland average-reward criteria. The second case is a constant discount rate, which leads to a...
متن کاملDiscrete Time Scale Invariant Markov Processes
In this paper we consider a discrete scale invariant Markov process {X(t), t ∈ R} with scale l > 1. We consider to have some fix number of observations in every scale, say T , and to get our samples at discrete points α, k ∈ W, where α is obtained by the equality l = α and W = {0, 1, . . .}. So we provide a discrete time scale invariant Markov (DT-SIM) process X(·) with parameter space {α, k ∈ ...
متن کاملWeek 1 Discrete time Gaussian Markov processes
These are lecture notes for the class Stochastic Calculus offered at the Courant Institute in the Fall Semester of 2012. It is a graduate level class. Students should have a solid background in probability and linear algebra. The topic selection is guided in part by the needs of our MS program in Mathematics in Finance. But it is not focused entirely on the Black Scholes theory of derivative pr...
متن کاملDiscrete - time Gauss - Markov Processes with Fixed Reciprocal Dynamics
Motivated by a problem considered earlier by Schrodinger [1]{[2], Jamison [3]{[4] and others, we examine in this paper the construction of Gauss-Markov processes with xed reciprocal dynamics. Given the class of reciprocal processes speci ed by a second-order model, a procedure is described for constructing a Markov process in the class with preassigned marginal probability densities at the end...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Kybernetika
سال: 2016
ISSN: 0023-5954,1805-949X
DOI: 10.14736/kyb-2016-3-0403